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RESOURCE MANAGEMENT IN A MULTI-PROCESSOR SYSTEM 



5 The present invention relates to a resource management method and apparatus that 

is particularly^ but not exclusively, suited to resource management of multi-processor real- 
time systems. • 

For systems-on-silicon (SoS) or systems-on-chip (SoCy, memory is becoreiing a 
dominant limiting factor, since, frQxn the point of view of the amojmt of silicon needed, 

10 adding another processing core is no longer a problem. As a consequence, a SoS or SoC 
may contain multiple processor cores. 

The management of memory is a crucial aspect of resource management for a 
multiprocessot systetn. Various methods have bedn developed to optimf2e'memoiy use foi* 
single processor systems, including generalizing the use of preemption points to fhe 

IS management of main memory, especially in real-time systems. In these approaches, rather 
than preempting tasks at arbitrary moments during flieir execution, tiiiose tasks are 
preferably only preempted at dedicated preemption points based on their memory usage. 

In a typical prior art approach, suspension of a task is referred to as task 
preemption, or preemption of a task, and the term "tasl^* is used to denote a unit of 

20 execution that can compete on its own for system resources such as memory, CPU, I/O 
devices, etc. For purposes of discussion, a task is assumed to be a succession of 
continually executing jobs, each of which comprises one or more sub-jobs. For example, a 
task can comprise ''demultiplexing a video stream**, and involve reading-in incoming 
streams, processing fhe streams and outputting corresponding data. These steps are carried 

25 out with respect to each incoming data stream, so that reading, processing and outputting 
with respect to a single stream corresponds to performing one job, each having three sub- 
jobs. Thus, when there is a plurality of packets of data to be read-in and processed, the job 
would be performed a corresponding plurality of times. A sub-job can be considered to 
relate to a functional component of the job and in a multiprocessor system each stream 

30 would be assigned to a different processor or subset of processors. 

A known method of scheduling a plurality of tasks in a data processing system 
requires that each sub-job of a task have a set of suspension criteria, called suspension data, 
that specifies the processing preemption points and corresponding conditions for 



US040013 2 

suspension of a sub*job based on its memory usage [4] [5]. The amount of memory that is 
used by the data processing system is thus indirectly controlled by this suspension data, via 
these preemption points, which specify flie amoimts of memoiy required at these 
preemption points in a job's execution. 
5 Thus, these preemption points can be utilised to avoid data processing system 

crashes due to a lack of memory. When a real-time task is characterized as con^)rising a 
plurality of sub-jobsi its pze6mption))oints preferably coincide with the sub-job boundaries 
of the task. 

Data indicative of m.einQiy us^tge of a task confprming to the suspension data 
10 . associated with each sub-job of a task can, for example, be embedded into a task via a line 
of code that requests' a descheduling event, specifying that a preemption point has be^ 
reached in the processing of the task, i.e., a sub-job bpundajy has been feached. .Thg^t is, ' 
the set of start pointe of the sub-jobs of a task constitute a set of preemption points of that 
task* the j^ preemption point Py of a task ti is characterized by infonnation related to the 
15 preemption point itself and information related to the succeeding non-preemptible sub-job 
interval Ig between the j^ preemption point and the next preemption point, i.e., the Q+l)^ 
pieenqption point. 

At run time, a task informs the controlling operating system when it arrives at 
preemption points, e.g. when it starts a sub-job, switches between sub-jobs, and completes 
20 a sub-job, and the operating system decides when and where execution of a task is 
preempted. Ideally, preemption may occur at a preemption point or at any other point 
during the execution of a task. However, such flexibility of choice of preemption comes at 
the cost of consistency so that preemption is limited to preemption points to maintain 
consistency. 

25 A prior art preemption point approach based on main memory requirements that 

does not jeopardize consistency of the system, necessarily limits the preemption of all tasks 
to their preemption points and matching synchronization primitives for controlling 
exclusive use of a resoiuce to both be within a sub-job boundary. As is known in the art, a 
component (e.g. a software component, which can comprise one or more tasks) can have a 

30 progmmmable interface that comprises the properties, functions or methods and events that 
the component defines [6]. For purposes of discussion, a task is assumed to be 
accompanied by an interface 100 that includes, at a minimum, main memory data required 
by the task, MPg 101b, as illustrated in HG. 1. 
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For the puiposes of discussion, a task is assumed to be periodic and real-time, and 
characterized by a period T and a phasing F, where 0 <= F < T, which means that a task 
comprises a sequence of sub-jobs, each of which is released at time F+nT, where n == 0 
...N. As an example, only and as illustrated in FIG- 2, set-top box 200 is assumed to 
5 execute three tasks - (1) display menu on the User Interface 205, (2) retrieve text 
information from a content provider 203, and (3) process some video signals — and each 
these 3 tasks is asstim6d* to comprise a plurality of sub-jobs. For ease of presentation, it is 
assumed that the sut)-jobs are executed sequentially. 

At least some of these sub-jobs can be preempted and the boundaries between these 
10 . sub-jobs tihat can be preempted provide preemption points and are summarized in Table 1 : 



Task 


Task description 


Numbfer bf preempt- 






able sub-jobs of task x\ 






m(i) 










display menu on the GUI 


3 


T2 


retrieve text information from content provider 


2 


^3 


process video signals 


2 



TABLE 1 



IS Referring also to FIG.3, for each task the suspension data 101 comprises: 

information relating to a preemption-point Fij 301, such as the maximum amount of 
memory MPy 302 required at the preemption point, and information relating to the interval 
lij 303 between successive preemption-points, such as the worst-case amount of memory 
MIy 304 required in an intra-preemption point interval (i represents task T{ and j represents 

20 a preemption point). 

More specifically, suspension data 101 comprises data specifying 

1 . preemption point j of the task xj (Py) 101a; 

2. maximum memory requirements of task Xi, MPi,j, at preemption point j of 
that task, wheie 1 ^ j ^ m(i) 101b; 
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3. interval, ly, between successive preemption points j and (j+1) 
corresponding to sub-job j of task Xj, where 1 :^ j < m(i) 101c; and 

4. maximum (i.e. worst-case) memory requirements of task Xj, Mlij, in the 
. interval j of that task, where 1 ^ j ^ m(i) 101 d. 

5 Table 2 illustrates the suspension data 101 for the current example (each task has its 

own interface, so that in the current example, the suspension data 101 corresponding to the 
first taslk X| comprises the data in the first row of Table '2, the suspension data 401 
corresponding to the second task xz comprises the second row of Table 2, etc.): 



Taskti 


MPi.i 


mi 












0.2 


0.6 


0.2 


0.4 


0.1 


0.6 


t2 


.0.1 


0.5 


0.2 


0.8 






^3 


0.1 


0.2 


0.1 . 


0.3 


mm / • 





10 ' 

TABLE2 

Suppose a set-top box 200 is equipped with 1 .5 Mbytes of memory. Under normal, 
or non-memory based preemption conditions, this set-top box 200 behaves as follows. 
15 Referring now to FIG. 4 A, a processor 401 may be expected to schedule tasks 

according to some sort of time slicing or priority based preemption, meaning that all 3 
tasks run concurrently, i.e. effectively at the same time. It is therefore possible that each 
task can be scheduled to run its most memory intensive sub-job at the same time. The 
worst-case memory requirement of these three tasks, M^, is given by: 

20 

M"* = 2 U Jnaxjif MI,^j (Equation 1) 

For tasks xj, X2 and X3 M'' is thus the maximum memory requirements of xi (being MIi,i) 
plus the maximal memory requirements of task xz (being Ml2^) plus the maximal memory 
25 requirements of task xa (being Ml3,2). These maximum requirements are indicated by the 
Table 2 entries in bold: 



M*" = 0.6 + 0.8 + 0.3- 1.7 Mbytes. 
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This exceeds the memory available to the set-top box 200 by 0.2 Mbytes, so that, in 
• the absence of any precautionary measures and if these sub-jobs are to be processed at the 
same time, the set-top box 200 crashes. 
5 Referring now to FIG. 5, suppose tasks are scheduled in accordance with a 

scheduling algorithm and a data structure is maintained for each task Xi after it has been 
created and tiiat matching pairs'of primitives, for exclusive us^e of a resource do not span a 
sub-job boundary. Suppose further that a scheduler 501 employs a conventional priority- 
based, preemptive scheduling algorithm, whicH essentially ensures that, at any point in 

10 time, tiie ctmeiftly running task is ttie one wife the higihest priority among all feady-to-run 
tasks in the ^stem. As is known ih tfee art, the scheduling behavior can be modified by 
selectively enabling and disabling preemptidn-for the running, or ready-tb-Mn, tosks. 

A task manager 503 receives the suspension data 101 corresponding to a newly 
received task and evaluates whetfier preemption is required or not and if it is required, 

15 passes this newly received information to the scheduler 501, requesting preemption. 
Suppose details of the tasks are as defined in Table 2, and assume that task xi (and only xi) 
is currently being processed and that the scheduler is initially operating in a mode m which 
there are no memory-based constraints. 

Suppose now that task X2 is received by the task manager 503, which reads the 

20 suspension data 101 from its inter&ce Inti 100, and identifies whether or not the scheduler 
501 is working in accordance witti memory-based preemption. Since, in this example, it is 
not, the task manager 503 evaluates whether ttie scheduler 501 needs to change to memory- 
based preemptioTL This therefore involves the task manager 503 retrieving worst case 
suspension data corresponding to all currently executing tasks (in this example task x\) 

25 from a suspension data store 505, evaluating Equation 1 and comparing the evaluated 
worst-case memory requirements with die memory resources available. Continuing wifli 
the example introduced in Table 2, Equation 1, for xi and X2, is: 

2 ?-i inax^P Mr,j = 0.6 + 0.8 « 1 .4 Mbytes 

30 

This is less than the available memory, so there is no need to change tiie mode of 
operation of the scheduler 501 to memory-based preemption (i.e. there is no need to 
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constrain the scheduler based on memory usage). Thus, if the scheduler 501 were to 
switch between task T| and task xi - e.g. to satisfy execution time constraints of task xi, 
meaning that both tasks effectively reside in memory at flie same time - the processor 
never accesses more memory than is available, 
5 Next, and before tasks X| and X2 have completed, another task X3 is received. The 

task manager 503 reads die suspension data 101 from interface Inta associated with the task 
X3, evaluating whether die scheduler 501 needs to change' to memory-based preemption. 
Assuming that the scheduler 50.1 is multi-tasking tasks xi and X2, the worst case memory 
requirements for all three tasks is now 
10 • . 

M**=2^?„,max7i;^Aff,,; = 0.6 + Q.8+-0.3=1.7Mbyte^ . , 

m 

This exceeds the available meniory, so the task manager 503 requests and retrieves 
memory usage data MPij,MIij 101b, lOId for all three tasks from the suspension data store 
15 505, and evaluates whether, based on this retrieved memory usage data, there are sufficient 
memory resources to execute all three tasks. This can be ascertained through evaluation of 
the following equation: 

M° = 51 ?«i ™*7i? ^^ij +niaxf«, (inaxji? Mlfj - max^ij^ MF^.y ) (Equation 2) 
20 = 0.2 -H 0.2 + 0. 1 + max(0.6 - 0.2, 0.8 - 0.2, 0.3 - 0.1) 

= 0.5 + 0.6 = 1 .1 Mbytes. 

This memory requirement is lower than the available memory, meaning that, 
provided the tasks are preempted based on their memory usage, all tiiree tasks can be 
25 executed concurrently. 

Accordingly, the task manager 503 invokes "memory-based preemption mode** by 
instructing the tasks to transmit deschedule instructions to the scheduler 501 at their 
designated preemption points MPij. In this mode, the scheduler 501 allows each task to 
run non-preemptively from one preemption point to the next, with the constraint that, at 
30 any point in time, at most one task at a time can be at a point other tiian one of its 
preemption points. Assuming that the newly arrived task starts at a preemption point, the 
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scheduler 501 ensures that this condition holds for the currently running tasks, thereby 
constraining all but one task to be at a preemption point. 

Thus, in one known memoiy-based preemption mode, the scheduler 501 is only 
allowed to preempt tasks at their memoiy preemption points (i.e. in response to a 

5 deschedule request from the task at their memory-based preemption points). 

When one of the tasks has terminated, the terminating task informs the task 
manager 503 that it is teiminatinfe causing the task . manager 503 to' evalwte Equation 1 
and if ttie worst case memory uss^ge (taking into accoukit removal of thTs task) is lower than 
that available to the scheduler 501, the task manager 503 can cancel mCTioiy-based , 

10 preemption, which has tiie benefit of enabling the ^tem to react faster to eTctemal events . 
(since the processor is no longer *T>locKed"»for the duration of the -sub-jobs). In' general, 
termination of a ta^sk is typically caused by its environment, e.g. a switch of channel by the^ 
user or a change in the data stream of the encoding applied (requiring another kind of 
decoding), meaning that the task manager 503 and/or scheduler 501 should be aware of tfie 

1 5 termination of a task and probably even instruct the task to terminate. 

^It should be noted that, when invoked, memoiy-based preemption constraints are 
obligatory. 

The tasks have been described as software tasks, but a task can also be 
implemented m hardware. Typically, a hardware device (behaving as a hardware task) is 
20 controlled by a software task, which allocates the (worst-case) memory required by tiie 
hardware device, and subsequently instructs the hardware task to run. When the hardware 
task completes, it mforms the software task, which subsequently de-allocates the memory. 
Hence, by having a controlling software task, hardware tasks can simply be dealt with as 
described above. 

25 This approach applies to a single processor system and is not optimized for a multi- 

processor system and thus a multi-processor optimization is needed. 

The present invention provides optimizations of the single processor approach to 
memory based resource management described above, for multi-processor systems. 
Consider a set r of n tasks Tj (1 ^ i < n) and a set P of p processors Tik (1 < k ^ p), where n 

30 is typically much larger than p and assume a fixed-piiority preemptive scheduling (FPPS) 
scheme for the non-constrained mode, and a fixed-priority scheduling scheme with 
deferred preemption (FPDP) scheme for the memory-based preemption mode. 
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There are three alternative preferred embodiments, depending on flie allocation of 
tasks to processors: 

1. Fixed Allocation: every task Xi is allocated to a particular processor Uk, i.e. 
task T," will exclusively execute on processor Tik. This embodiment is 

5 preferred when processors are dedicated, i.e., where each processor differs 

essentially from every other processor. 

2. Variable Allocation: every task Xi may execute on every processor TCk- Af 
run-time the scheduler determines which processor executes, which taisk. A 
task may be preempted while running on one processor, aiid later continues 

10 on aifotii^t. This embodiment is preferred when all the processors; are 

identical. ; 

3. " Mixed Allocation: eveiy task xj is allocated to a subset of processors. This 

is a natural approach when the set of processors can be divided into subsets 
in- which the processors ate identical. 
IS The foregoing and other features and advantages of the invention will be apparent 

from tiie following, more detailed description of preferred embodiments as illustrated in 
the accompanying drawings in which reference characters refer to the same parts- 
tiiroughout the various views. 

FIG. 1 illustrates a schematic diagram of components of a task interface according 
20 to an embodiment of tiie present invention; 

FIG. 2 illustrates a schematic diagram of an example of a digital television system 
in which an embodiment of the present invention is operative; 

FIG. 3 illustrates a schematic diagram of the relation^ips between components of 
the task interface illustrated in FIG. 1 for a singile processor. 
25 FIG. 4A illustrates components constituting the set-top; box of FIG. 2, for a single 

processor system. 

FIG. 4B illustrates components constitutmg the set-top box of FIG. 2 for a 
multiprocessor system. 

FIG. 5 illustrates components of tiie processor of the set-top box illustrated in FIG. 
30 2 and FIG. 4A. 
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It is to be understood by persons of ordinary skill in the art that the following 
descriptions are provided for purposes of illustration and not for limitation. An artisan 
understands that there are many variations that lie within the spirit of the invention and the 
scope of tiie appended claims. Unnecessary detail of known functions and operations may 
S be omitted from the current description so as not to obscure the present invention. 

High volume electronic (HVE) consumer systems, such as digital TV sets, digitally 
improved analog TV sets and set-top boxes (STBs) must provide real-time Services while 
* remaining cost-effective and robust. Consumer products;, by their nature; are heavily 
resource constrained. As a consequence, the available resburces' have to be used very 

10., efficiently, while preserving typical qualities of HVE consumer systems; such as 
robustness, and meeting stringent timing requirements. Concerning robustness, no one 
expects^ for eiicample, a TV set to fail wifii the message '"plea^ reboot the system'*.- 

Significant parts of the media processing in HVE consumer systems are 
implemented in on-board software that handles multiple concurrent streams of data, and in 

IS particular must very efficiently manage system resources, such as main memory, in a 
multi-tasking environment Consider a set-top box as an example of an HVE consumer 
system requiring real-time resource management Conventionally, as illustrated in FIG. 2, 
a set-top box 200 receives input for television 201 from a content provider 203 (a server or 
cable) and firom a user interface 20S. The user inter&ce 20S comprises a remote control 

20 interface for receiving signals from a user-controlled remote device 202, e.g., a handheld 
infrared remote transmitter. The set-top box 200 received at least one data stream from at 
least one of an antenna and a cable television outlet, and performs at least one of 
processing the data stream or forwarding the data stream to television 201. A user views 
die at least one data stream displayed on television 201 and via user interface 20S, makes 

25 selections based on what is being displayed. The set-top box 200 processes the user 
selection input and based on this input may transmit to the content provider 203 the user 
input, along with other information identifying tfie set-top 200 and its capabilities. 

FIG. 4B illustrates a simplified block diagram of an exemplary system 450 of a 
typical set-top box 200 that may include a plurality of processors 460.1 - 460.3 managed 

30 by a control and allocation logic module which allocates tasks to processors 460.1 - 460.3 
and controls the overall operation of set-top box 200. The control and allocation logic 
module 451 comprises a data receiver 452 for receiving put data from the network 407 and 
from storage 406, an evaluator 453 for evaluating memory usage, an allocator 454 for 
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allocating tasks to processors^ a selector 455 for selecting tasks to initiate and terminate 
execution thereof and a scheduler 501 for scheduling tasks for execution and descheduling 
executing tasks. The control and allocation logic module 451 is coupled to a television 
tuner 403, a memory 405, a long term storage device 406, a communication interface 407, 
5 and a remote interface 409. The television tuner 403 receives television signals over 
transmission line 41 1 and these signals may originate from at least one of an antenna (not 
shpwn) and a cable television outlet (not shovm). The control & allocation logic module 
451 manages the user interface 205, providing data, audio and video output to ttie 
television 201 via line 413. The remote interface 409 receives signals ftom the remote 

10 control via the. wireless conncqtion 4lX. The communi9.atiQn interface 407 interfaces 
« between the set^top box 200 and least one remote processing system, such a Web server, 
via data path 417. The commjunic^tion inteiifoce 417 is'at least one of a telephone modem, 
an Integrate Services Digital Network (ISDN) adapter, a Digital Subscriber Line (xDSL)» a 
cable * television modem, and any other suitable data communication device. The 

IS exemplary system 450 of FIG. 4B is for descriptive purposes only. Altfiough the 
description may refer to terms commonly used in describing particular set-top boxes 200, 
ttie description and concepts equally apply to ofter control processors, including systems 
having architectures dissimilar to that shown in FIG. 4B. 

The control and allocation logic module 451, in a preferred embodiment^ is 

20 configured to allocate a plurality of real-time tasks relating to the control of the set-top box 
200 to a plurality of multi-processors 460.1 - 460.3 that share a memory 405. These real- 
time tasks include changing channels, selection of a menu option displayed on the user 
inter&ce 205, decoding incoming data streams, recording incoming data streams using the 
long term storage device 406 and rqplaying them, etc. The operation of the set-top box is 

25 determined by these real-time control tasks based on characteristics of the set-top box 100, 
incoming video signals via line 411, user inputs via user interface 205, and any other 
ancillary input 

In a preferred embodiment, multi-processors share memory 405. These multi- 
processors 460.1 - 460.3 may each be CPUs, or co-processors, or other processing devices. 
30 In a preferred embodiment, the same task is never executed simultaneously by two (or 
more) processors. In a preferred embodiment, the control and allocation logic module 
comprises a single task-manager for the entire set of processors 460.1 - 460.3. This is a 
centralized approach for discussion purposes only. The present invention is not 
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constrained to centralized approaches, and decentralized versions may l^e easily conceived 
by individuals experienced in the art. 

Fixed allocation 

Whene:ver every task x is allocated to a particular processor ti, the set T of tasks 
5 may be partitioned into p disjoint sets Ti - Tp, where the subset Tk is allocated to processor 
7t|c. The maximum* ai65unt of memory required by tlie subset of tasks Tk under fpps as 
executed by processor 7T;k is given by (Eq. 1 s'), which is a variant of (Eq. 1). The term nk in 
(Eq. Is') denotes the number (i.e. flie cardinality of the subset Fk) of tasks allocated to 
processor Ttk, and the variable i is assumed to raiige over the tasks of Fk. 

10 

Mk^ =: Z 2i ™^7i? ^ij * ' (Eq. Is') . - . 

The total memory requirements of the entire set T 6f tasks is determined by 
adding the results found for each subset of tasks; see (Eq. Im^*). 

15 

M'-Zi^iT (Eq.lm«*) 

When does not exceed the available memoiy Msys> ^ere is no need to constrain 
the scheduling of the tasks on any of the processors. When does exceed Msys, we may 
20 constrain the scheduling of one or more tasks on one or more processors. The effect of 
constraining the scheduling of all tasks on a single processor can be determined using Eq. 
2s'), which is a variant of (Eq. 2s). 

Mk"^« ^^Ur^^i^MP.j'^tmK^.im^^^^^ (Eq. 2s') 

25 

The effect of constraining the scheduling of all tasks on all processors can be 
determined by (Eq. 2m^"'), where the total memoiy requirements is the sum of the 
memoiy lequiiements Mk^ of each set Fk. 



30 



(Eq. 2m^«) 
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Clearly, there are many intermediate alternative embodiments, such as constraining 
all the tasks on just a subset of the processors, and constraining only a subset of tasks on a 
subset of the processors. 

5 . , 

Varidbl^ allocation ' - . - 

Alternatively, every task m^ be executed on every processor 46d.l - 460.3, and 
scheduling of the tasks is performed by the control and allocation logic module 451 . The 
maximum memory requirements for the non-constrained mpde remains tiie same, i.e. . 
10 can be determined using (Eq. U) « 

M^^-^UmBxjS^MT.j (Eq.Js) 

The constrained mode (i.e. all tasks are only preempted at their preemption points) 
1 S requires a variant of (Eq. 2s) 

M"^ = X M "^^1-^ ^^iJ (maxjiP Mr,j - maxji? MP,j) (Eq. 2s) 

= 0.2 + 0.2 + 0.1 + max(0.6 - 0.2, 0.8 - 0.2, 0.3 - 0.1) 
= 0.5 + 0.6 = 1.1 Mbytes. 

20 

because p tasks may now run in parallel on p processors. The total^ memory 
requiremmts is now given by (Eq. 2m^. 

25 Y.UrtiBx'^^MP.^-^m^^^^^^^^^^^^^ (Eq. 2m-0 

Note that (Eq. 2m'^ assumes n ^ p, and that (Eq. 2m'^ is also only valid for n ^ p. 
For the special case n< p, the equation can be sinq>lified to 

30 M°=XMniax7i(>M/,^ 
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Clearly, there are many intermediate embodiments, such as constraining only a 
subset of tasks. 

As an example, consider the case of two processors (i.e. p = 2), and three tasks (i.e. 
n = 3). It is assumed that the tasks have the same characteristics (i.e. memory- 
S requirements) as described in Tables 1 and 2 above, and their accompanying discussion* . 
The maximum memory requirements M** for the non-constrained mode remains the same, 
i.e. can be determined using (Eq. 1)» and heiice exceeds the available memory M^. Using 
(Eq. 2m^ the maximiim memory requiremeilts ft^for memory-based preemption is: 

10 ' M°= Y.i'^maK^l^MP.j^mBK^^^^^^^^ 

= 0.2 + 0.2 + 0, 1 + max(0,4 0.6, 0.4 + 0.2, 0.jS + 0.2) 
= 0.5 + 1.0= 1.5 Mbytes 

The memory requirement is lower than the available memory, meaning that 
1 5 provided that the tasks are preempted only at their preemption points, all three tasks can be 
executed concurrently. 

Mixed Allocation 

Assume there are s pair-wise disjoint subsets Pi, Ps of processors. Let every task 
20 be allocated to a particular subset Pi of processors, where 1 :^ 1 £ s. The set of tasks may 
therefore be divided in s pair«>wise disjoint subsets Ti, Tg of tasks. For ease of 
presentation, the tasks in subset Ti are denoted by xu where 1 !^ i ^ ni, i.e. the tasks per 
subset of tasks are numbered. Similar to the variable allocation described above, flie 
maximum memory requirements Mi^ for subset P| for the non-constrained mode can be 
25 determined using (Eq. Is'')- 

The maximum amount of memoiy required by the subset of tasks Fi in the non- 
constrained mode executed by ttie subset P| of processor Ttk is given by (Eq. ls")» which is 
a variant of (Eq. 1). 



30 



(Eq. Is") 
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Note that (Eq. Is") is similar, but not identical, to (Eq. Is'). Whereas 1 ranges over 
subsets of processors in the former equation, k ranges over the processors in a subset in the 
latter equation. The total memory requirements for all s subsets of processors can be 
found by taking the sum of the requirements for the individual subsets: 

5 

Im"^'^) 

When exceeds Msys, the scheduling is constrained of one or more tasks of one or 
10 more subsets of tasks executed on their associated subsets gf processors. The effect of 

constraining the scheduling of all m tasks of Tj on a single subset Pi ofpi proQessors can be 
determined using (Eq. 2m"***), which is similar to (Eq. 2m^: ' * ' , 

15 'Et.rn^%^MP,^+rn^^^^^^^XiU^ (Eq^lm^ 
Similarly to (Eq. Zm"^, (Eq. 2m"'*) only holds for ni ^ pi. 

The effect of constraining the scheduling of all tasks of every subset of tasks on 
20 every subset of processors can be determined by (Eq. 2m'""'), where the total memory 
requirements is the sum of the memory requirernents of each subset of processor 
P|. 



M^^Z?".^/" (Eq.2m'"'*') 

25 

As for the fixed allocation and variable allocation cases described above, for mixed 
allocation ttiere are many intermediate solutions between the non-constrained mode and the 
memory-based preemption mode in which all tasks are only preempted at tiaeir preemption 
points. 

30 

While the preferred embodiments of the present invention have been illustrated and 
described, it will be understood by those skilled in the art that various changes and 
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modifications may be made, and equivalents may be substituted for elements thereof 
without departing from the true scope of the present invention. In addition, many 
modifications may be made to adapt the teaching of the present invention to a particular 
situation without departing from its central scope. Therefore it is intended that the present 
invention not be limited to die particular embodiments disclosed as the best mode 
contemplated for carrying out the present invention, but that the present invention include 
all eibbodim'ents falling within the scope of the appended claims. ' 
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CLAIMS: 

1. A method of scheduling a plurality of tasks in a data processing system 
having a plurality of processors, comprising the steps of: 

for each task of the plurality, providing suspension data specifying suspension of 
,the task based on memory used thereby; 

allocating each of Said plurality of tasks to ^a processor of said plurality .of 
processors; and 

each processor performing the steps of: \ 

(i) processing dne the fsteks allocated to the processor, 

(ii) . monitoring for an input indicative of memory :used by the task 
matching the suspension data associated with the task, 

(iii) suspending said task on the basis of said monitored input, and 

(iv) processing a different one of ttie tasks allocated to the processor. 

2. The method of claun 1 , wherem: 
allocation of a task to a processor is based on one of - 

a. fixed allocation having every task allocated to a particular processor; 

b. variable allocation having every task allocated to every processor, and 

c. mixed allocation having every task allocated to a subset of said plurality of 
processors. 

3. The method of claim 2, wherein said input comprises data indicative of a 
suspension request. 

4- The method of claim 3, furflier comprising the steps of: 
receiving first data identifying maximum memory usage associated with the 
plurality of tasks; 

receiving second data identifying memory available for processing the plurality of 



identifying, on the basis of the first and second data, whether there is sufficient 
memory available to process the tasks; and 
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wherein, said monitoring and suspending steps are performed only in response to 
identifying insufficient memory. 

5. The mefliod of claim 4, fiirther comprising the steps of: 
monitoring termination of tasks; and 

in response to a task termination, repeating said step of identifying availability of 
memoVy in response to a task terminating. • 

6. The mefhod of claim 5, in which, in response to identifying sufficient 
memory to exeoiit)e4fae«emainiiTg tasics^&emonitoriilB step Is deemed, unpecessary. 

7. Ihe method pfclaim 6, &rQier comprising ttiestep^ of: 

receiving first data identifying maximum memory usage associated with the 
plumlily of tasks; 

receiving second data identifying memory available for processing the plurality of 

tasks; 

identifying, on tihe basis of the first and second data, whether there is sufficient 
memory available to process the tasks; and 

wherein, said monitoring and suspending steps are performed only in response to 
identifying insufficient memory. 

8. The method of claim 7, fiirdier comprising the steps of: 
monitoring termination of tasks; and 

in response to a task termination, repeating said step of identifying availability of 
memory in response to a task terminating. 

9. The method of claim 8, in which, in response to identifying sufficient 
memory to execute the remaining tasks, the monitoring step is deemed unnecessary. 

10. The method of claim 2, furflier comprising the steps of: 

receiving first data identifying maximum memory usage associated with the 
plurality of tasks; 
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receiving second data identifying xnemoiy available for processing flie plurality of 

tasks; 

identifying, on the basis of the first and second data, whether there is sufficient 
memory available to process the tasks; and 

wherein, said monitoring and suspending steps are performed only in response to 
identifying insufficient memory. 

1 1 . The method claim'lO, further comprising the steps of: 
monitoring termination of tasks; and 

* in respcmse to a task tennii|$ition» repeating said of identifying availability of 
mCTiory in response fo a task termin^tiing. 

12. The mettiod according to claim 11, in which, in response to identifying 
sufficient memory to execute the remaining tasks, the monitoring step is deemed 
imnecessary. 

13. A method of schedulmg a plurality of tasks in a data processing system 
having a plurality of processors, comprising the steps of: 

for each task of the plurality, providing suspension data specifying suspension of 
the task based on memory used thereb}^ 

allocating each of said plurality of tasks to a processor of said plurality of 
processors based on one of - 

- fixed allocation having every task allocated to a particular processor, 

- variable allocation having every task allocated to every processor, and 

- mixed allocation having every task allocated to a subset of said plurality of 
processors; and 

each processor performing the steps of: 

(i) processing one flie tasks allocated to the processor, 

(ii) monitoring for an input indicative of memory used by the task 
matching the suspension data associated with the task, 

(iii) suspending said task on the basis of said monitored input, and 

(iv) processing a different one of the tasks allocated to the processor. 
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14. A scheduler for use in a data processing system having a plurality of 
processors, the data processing system being arranged to execute a plurality of tasks on 
said plurality of processors and having access to a specified amount of memory for use in 
executing the tasks> the scheduler comprising: 

a data receiver arranged to receive data identifying maximum memory usage 
associated with a task; * , ' * * 

an evaluator arranged^ to identify, on the basis of the' received data, whether there is 
sufiGcient memory to execute the tasks; 

an allocator arranged to allocaite each of said plurality of tasks to a processor of said, 
plurality of processors baSed on one of - * 

a. fixed allocation having every t@Lsk allocated to a p^cular processor, ^ . 

b. variable allocation having every task allocated to every processor, and 

c. mixed allocation having every task allocated to a subset of said plurality of 
processors; 

a selector arranged to select at least one task for suspension during execution of the 
task, said suspension coinciding with a specified memory usage by the task; and 

a scheduler 501 arranged to initiate execution of said allocated task and suspend 
said selected task, 

wherein, in response, to the evaluator identifying that there is insufficient memory to 
execute the plurality of tasks, the selector selects at least one task for suspension, on the 
basis of its specified memory usage, and tfie specified amount of memory available to the 
data processing system, and the scheduler suspends execution of the at least one selected 
task in response to the task using the specified memory. 

15. A scheduler according to claim 14, wherein the evaluator is arranged to 
monitor termination of tasks, and in response to a task terminating, to identify whether 
there is sufficient memory to execute the remaining tasks. 

16. A scheduler according to claim 15, wherein, in response to the evaluator 
identifying sufficient memory to execute the remaining tasks, the selector is arranged to 
deselect said selected at least one task. 
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17. A data processing system having a plurality of processors arranged to 
execute a plurality of tasks, the data processing system including: 

memory arranged to hold instructions and data during execution of a task; 

receiving means arranged to receive data identifying maximum memory usage 
associated with a task and data specifying preemptability of the task; 

evaluating means arranged to identify, on the basis of the received data, whether 
there is sufficient inemojcy to execute the tasks;' 

an allocator arranged to allocate each t>f said plpxality of tasks to a processor of said 
plurality of processors based on on6 of - 

- fixed allocation having every task allocated to a particular processor, 

- variable allocation having every task allocated to every processor, and , 

« mixed allocation having ev^ task allocated to a sul^set of said, plurality of 
processors; and 

a scheduler arranged to schedule execution of the tasks on the basis of input 
received from tiie evaluating means, 

wherein, in response to identification of insufficient memory to execute the- 
plurality of tasks, the scheduler is arranged to suspend execution of at least one task in 
dependence on memory usage by the task. 

18. A method of transmitting data to a data processing system having a plurality 
of processors, the mettiod comprising: 

allocating each task of a plurality of tasks to a processor of said plurality of 
processors based on one of - 

- fixed allocation having every task allocated to a particular processor, 

- variable allocation having eveiy task allocated to every processor, and 

- mixed allocation having every task allocated to a subset of said plurality of 
processors; 

transmitting data for use by the data processing system in processing each task of 
said plurality of tasks; 

transmitting suspension data specifying suspension of each task of said plurality of 
tasks based on memory usage during processing thereof; 

wherein, the data processing system is configured to perform a process comprising: 
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monitoring for an input indicative of memoiy usage of each task matching the 
suspension data associated with the task; and 

suspending processing of said each task on the basis of said monitored input. 

19. A method according to claim 18, wherein the suspension data includes data 
identifying maximum memory usa.ge associated with said each task. 

20. A method according to claim 18, wherein flie su^ension data identifies at 
least one point at which processing of each task can be suspended, based on memory usage 
of said each task. . 

21. A method according .to claim 20, wherein, said eaGh task comprises a 
plurality of sub-jobs and said data identifying at least one point at which processing of said 
each task can be suspended corresponds to each such sub-job. 

22. A method according to claim 20, wherein the suspension data includes data 
identifying maximum memory usage associated with said each task. 

23. A method according to claim 22, wherein said each task comprises a 
plurality of sub-jobs and said data identifying at least one point at which processing of said 
each task can be suspended corresponds to each such sub-job. 

24. A meftod of configuring a plurality of tasks for use in a data processing 
system havmg a plurality of processors, the method including associating suspension data 
with flie task, the suspension data specifying suspension of the task based on memory 
usage associated therewith, wherein the data processing system is arranged to perform a 
process in respect of a plurality of tasks executing on a plurality, of processors, the process 
comprising: 

allocating each task of said plurality of tasks to a processor of said plurality of 
processors based on one of - 

- fixed allocation having every task allocated to a particular processor, 

- variable allocation having every task allocated to every processor, and 

I 
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- mixed allocation having every task allocated to a subset of said plurality of 
processors; 

monitoring for an input indicative of memory usage of the task matching the 
suspension data associated with the task; and 

suspending processing of said task on the basis of said monitored input 

25. A computer program, comprising a set of instructions arranged to cause a 
processing system to perform the method according to of claiifi 1. 

26. A computer program, cothprising a set of iiistructions suxaqged to cau^e a . 
processing system to perform the method according to of claim 2. 
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ABSTRACT 

A method and apparatus is provided for use by a scheduler of a multi-processor data . 
5 processing system to select task preemption points based .on main memory requirements. 
There are three alternative pref^ed CTibodiments, depending on ,tiie allocatipn of tasks to 
processor]^: (1) Fixed Allocation: every tastc'is allocated to a particitlar processor, i.e. eadh task 
exclusively executes on a given processor.. This embodiment is prefeired whefh prpcessdrs are 
dedicated, i.e;., where eaph proce^i^or differs' essentially firom dvery pther processor (2) 

10 Variable Allocation: every task may execute .on every processor. A^t tun-time tiie scheduler * 
determines which processor executes, which task. A task may be preempted while runnixig on 
one processor, and later continue' bh another. This embodiment Is preferred wheh all the 
processors are identical; and (3) Mixed Allocation: every task is allocated to a subset of 
processors. This is a natural approach when the set of processors can be divided into subsets 

IS in which the processors are identical. 
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